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DETAILED ACTION 

Response to Arguments 

Applicant's arguments filed 22 December 2010 have been fully considered, but 
they are moot in view of the new rejections. 

Claim Rejections - 35 USC §112 

The following is a quotation of the first paragraph of 35 U.S.C. 112: 

The specification shall contain a written description of the invention, and of the manner and process of 
making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the 
art to which it pertains, or with which it is most nearly connected, to make and use the same and shall 
set forth the best mode contemplated by the inventor of carrying out his invention. 

Claims 80-86, 89-93, and 95 are rejected under 35 U.S.C. 112, first 
paragraph, as failing to comply with the written description requirement. The 

claims contain subject matter which was not described in the specification in such a way 
as to reasonably convey to one skilled in the relevant art that the inventors, at the time 
the application was filed, had possession of the claimed invention. Claim 80 requires a 
storage device that is searchable by content. The claim also requires that the storage 
device stores video frames. However, the specification teaches that a content 
addressable memory stores pointers to video frames or representations of video 
frames, but does not actually store video frames. Para. 0049. Therefore, the claim and 
its dependents contain new matter. 
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Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 70, 74, 79-86, 89, 92, 93, and 95 are rejected under 35 U.S.C. 103(a) 
as being unpatentable over US 5,226,177 ("Nickerson") in view of US 5,517,251 
("Rector") and US 5438535 ("Lattibeaudiere"). 

Claim 70. Nickerson teaches an apparatus for analyzing responses to at least 
one stimulus stream (visually perceptible display, Abstract) comprising an input for 
receiving responses from one or more respondents to the at least one stimulus stream 
(see Abstract, Fig. 1); a correlator including a processor configured to correlate the 
responses with time slices (SMPTE time codes, col. 6, II. 48-58) of the stimulus stream 
to generate an associative mapping of the responses and the time slices of the stimulus 
stream (see Fig. 9: illustrating a mapping of the correlation of the response signal 130 
with video time codes; col. 6, II. 40-66; col. 8, II. 4-7); a storage module coupled with 
the correlator to store the associative mapping as a table (col. 10, II. 49-56, discussing 
tabulating the results); and a user interface operatively coupled with the storage module 
allowing an operative to search the associative mapping on the basis of analyses of the 
responses (see col. 10, II. 49-56 (discussing various statistical analyses that may be 
performed on the correlated data)). 
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Nickerson does not further teach storing the table such that the table can be 
searched simultaneously and in parallel, and Nickerson does not further teach a user 
interface allowing an operator to retrieve time slices of the stimulus stream for display 
wherein playback of the time slices of the stimulus stream may be displayed on the user 
interface. 

Rector teaches an apparatus for correlating a video signal with analog response 
signals (Abstract). The video signal may be stored as a digital signal correlated with the 
response signals (col. 2, II. 59-61 ; col. 4, II. 1-6; col. 7, II. 7-18). The digital signals are 
associatively mapped by time slices such that the signals are synchronized and 
integrated in a single file (col. 3, II. 11-17). The apparatus includes a user interface for 
searching the associative mapping and retrieving time slices of the stimulus stream for 
display, e.g., in order to display video correlating to anomalous response signals (col. 
1 0, II. 36-43; col. 11,11. 5-1 1 & 40-50). 

It would have been obvious to apply Rector's teaching of digitizing a video tape 
and correlating the digitized signal with response signals to the system of Nickerson for 
the purpose of rapidly analyzing the correlation between the video signal and the 
response signals (see Rector, col. 1 1 , II. 5-1 1 & 40-50). 

Nickerson in view of Rector does not further teach storing the table such that the 
table can be searched simultaneously and in parallel to encompass correlated data for 
every time slice in the table. 
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Lattibeaudiere teaches a method of storing a table in a content-addressable 
memory such that the table can be searched simultaneously and in parallel (cols. 1 and 
2). 

It is obvious to combine known elements according to known methods to yield 
predictable results. Therefore, it would have been obvious to store the response data of 
Nickerson in view of Rector in the CAM of Lattibeaudiere to yield the predictable result 
of more quickly searching the results database (Lattibeaudiere col. 2, II. 3-16). 

Claim 74. Nickerson and Rector further teach storing a multi-channel associate 
mapping (see claim 70 rejection), thus implying a multi-channel associative cache (a 
memory, i.e. cache, for storing the multi-channel associative mapping). 

Claim 79. Nickerson further teaches that the stimulus stream may be recorded 
(col. 7, II. 18-24), i.e. delayed in time. 

Claim 80. Nickerson teaches an apparatus for analyzing a response to a stimulus 
(Abstract), the apparatus comprising a stimulus input that receives a stimulus signal 
representing the stimulus (see Fig. 1 ; col. 2, II. 58-68 (video program material is 
received by the central processor in order to overlay the response data on the video 
signal); Fig. 9); a response input that receives at least one response signal (col. 2, II. 
58-68; Fig. 9 (illustrating response curve 130)), each response signal being indicative of 
a response to the stimulus at a time slice of the received stimulus signal (see Fig. 9 (the 
horizontal axis of the response curve comprises time codes)); a correlator coupled with 
the stimulus input and the response input;and a storage module coupled with the 
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correlator to store the associative mapping as a table (col. 10, II. 49-56, discussing 
tabulating the results). 

Nickerson does not further teach that the storage device is content searchable by 
an entire row or column of variables, or retrieving video frames responsive to a search. 

Rector teaches a storage method for storing response data correlated with video 
data in an interleaved file format such that blocks representing different streams of data 
are interleaved with each other (col. 10 II. 18-31). The analysis system allows a single 
variable to be analyzed across time (e.g. a heart rate variable may be analyzed for 
anomalies, col. 10, II. 39^1) and across the variables (e.g., a display frame associated 
with the anomalous heart rate signal can be immediately retrieved, col. 10, II. 41-42). 

It would have been obvious to apply Rector's teaching of digitizing a video tape 
and correlating the digitized signal with response signals to the system of Nickerson for 
the purpose of rapidly and effectively analyzing the correlation between the video signal 
and the response signals (see Rector, col. 1 1 , II. 5-1 1 & 40-50). 

Lattibeaudiere teaches a method of storing a table in a content-addressable 
memory such that the table can be searched by content (cols. 1 and 2). 

It is obvious to combine known elements according to known methods to yield 
predictable results. Therefore, it would have been obvious to store the response data of 
Nickerson in view of Rector in the CAM of Lattibeaudiere to yield the predictable result 
of more quickly searching the results database (Lattibeaudiere col. 2, II. 3-16). 

Claim 81 . Nickerson in view of Rector further teaches a multi-channel associative 
mapping for recording multiple response signals (Nickerson, col. 8, I. 42-55; Rector, 
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Abstract), thus implying a multi-channel associative cache (a memory, i.e. cache, for 
storing the multi-channel associative mapping). 

Claim 82. Nickerson further teaches that each digital time slice comprises a 
frame correlated with a response signal 130, since an SMPTE time code is stored on a 
per-frame basis. 

Claim 83. Nickerson in view of Rector further teaches measuring an 
environmental condition and associating the measurements with the time slices in the 
associative mapping (Rector, col. 6, II. 30-35). 

Claim 84. Nickerson further teaches that the stimulus stream may be recorded 
(col. 7, II. 18-24), i.e. delayed in time. 

Claim 85. Nickerson teaches displaying the data as it received, i.e., 
contemporaneous with its creation (col. 8, 1. 7-11). 

Claim 86. Nickerson teaches that groups of responses may be associated with 
different variables (see Fig. 10); and that viewers may be disposed at different angles 
(e.g., in Fig. 1 , a male user of response device 12 is disposed at a different angle than a 
female user of apparatus 14). 

Claim 89. Nickerson teaches an analyzer for statistically analyzing the response 
signals (col. 10, I. 49-56), wherein the analyzer may be used to find selected segments 
of the stimulus signal, such as a "question 4" segment (Fig. 10). 

Claim 92. Nickerson in view of Rector further teaches a graphical user interface 
for selecting which statistical analysis is performed (see Nickerson, col. 8, II. 56-63). 
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Claim 93. Nickerson in view of Rector further teaches means for displaying the 
associative mapping (see Nickerson Fig. 9). 

Claim 95. Nickerson in view of Rector further teaches storing the associative 
mapping so that the user can randomly select and access content from the storage 
device (see Rector, col. 1 1 , II. 5-1 1 & 40-50). 

Claim 90 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Nickerson in view of Rector, Lattibeaudiere, and the provided definition of 
"interpolation." 

Claim 90. Nickerson teaches performing a statistical analysis on the response 
signals (col. 10, 1. 49-56), but does not explicitly teach that the statistical analysis 
comprises an interpolation. 

The provided definition 3.b. teaches that the "Method of Interpolation" is useful 
for determining an equation between time and a quantity determined by observations. 

Therefore, it would have been obvious to use the described Method of 
Interpolation for the purpose of finding an equation between the time and the observed 
response signals, thus allowing for the inference of additional information based on the 
known information. 

Claim 91 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Nickerson in view of Rector, Lattibeaudiere, and the provided definition of 
"extrapolate." 
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Claim 91 . Nickerson teaches performing a statistical analysis on the response 
signals (col. 10, I. 49-56), but does not explicitly teach that the statistical analysis 
comprises an extrapolation. 

The provided definition 2. a. teaches that extrapolation is useful for estimating the 
values of a series outside a range in which some of its values are known. 

Therefore, it would have been obvious to use the extrapolation method for the 
purpose of estimating the values of such series as the response curve 130 (Fig. 9) or 
the age groups (Fig. 10) outside of the known values in order to infer additional 
information based upon the known information. 

Claims 97 and 103-105 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Nickerson in view of Rector and US 5802361 ("Wang"). 

Claim 97. Nickerson teaches a method for analyzing responses to at least one 
stimulus stream (visually perceptible display, Abstract) comprising receiving responses 
from one or more respondents to a stimulus stream (see Abstract, Fig. 1); a correlator 
for associating the responses with time slices (SMPTE time codes, col. 6, II. 48-58) in 
which the responses are made (see Fig. 9 (illustrating a mapping of the correlation of 
the response signal 130 with video time codes); col. 6, II. 40-66; col. 8, II. 4-7); a 
storage module coupled with the correlator to store the associative mapping including 
the responses and the time slices of the stimulus stream (col. 6, II. 40-43); and a user 
interface operatively coupled with the storage module allowing an operative to search 
the associative mapping on the basis of analyses of the responses (see col. 10, II. 49- 
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56 (discussing various statistical analyses that may be performed on the correlated 
data)). 

Nickerson does not further generating the claimed summary video. 

Rector teaches a similar method for correlating response to video signals 
(Abstract). The apparatus further includes a user interface for searching the associative 
mapping for anomalous responses and retrieving the corresponding time slices of the 
stimulus stream for display (col. 1 0, II. 36-43; col. 11,11. 5-1 1 & 40-50). Rector thus 
thus displays a summary of the video pertaining to the search result. However, Rector 
does not further teach generating a summary video that is a series of non-contiguous 
video segments. 

Wang teaches a method of searching video images comprising entering a search 
query (col. 4, II. 42-64) and displaying the retrieved search results in a temporal order 
(col. 5, II. 35-39), thus generating a summary of the retrieved search results. 

It is obvious to combine known elements according to known methods to yield 
predictable results. Therefore, it would have been obvious to combine Wang's 
summarization method with the search system of Rector to yield the predictable result 
of providing a summary video corresponding to the retrieved search results, the 
summary video comprising non-contiguous segments depending on the matching data. 

Claim 103. Nickerson and Rector further teach a multi-channel associative 
mapping for recording multiple response signals (Nickerson, col. 8, I. 42-55; Rector, 
Abstract). 
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Claim 104. Nickerson in view of Rector further teaches logging locations of 
stored time slices of the at least one stimulus stream so that the associative mapping 
directs retrieval of time slices for playback (Rector, col. 1 1 , II. 5-1 1 & 40-50). 

Claim 105. Nickerson in view of Rector further teaches measuring an 
environmental condition and associating the measurements with the time slices in the 
associative mapping (Rector, col. 6, II. 30-35). 

Claims 98-100 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Nickerson in view of Rector, Wang, and US 5,812,642 ("Leroy"). 

Claim 98. Nickerson in view of Rector does not further teach determining whether 
an object is present in a time slice and associating the determination with the time slice 
in the associative mapping. 

Leroy teaches a method for analyzing response signals to a promotion stimulus 
stream (Abstract) wherein the stimulus stream comprises objects such as people (see 
Fig. 7: "BOB"; and col. 7, II. 42-60). The method determines which time slices the object 
is present in (see Fig. 7). The determination is associating with a time slice in an 
associative mapping of the stimulus stream, the time data, and the response data (see 
Fig. 7). 

It would have been obvious to add Leroy's method for determining when objects 
are present in the stimulus stream for the purpose of analyzing the response data with 
respect to a particular object, thus providing more specific information about the 
response associated with that object (see Leroy, col. 7, II. 50-52). 
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Claim 99. Leroy further teaches that the object comprises a person (col. 7, II. 42- 

60). 

Claim 100. Nickerson further teaches that the stimulus stream is a video (col. 7, I. 
59-68), which comprises an audio stream. 

Claims 101 and 102 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Nickerson in view of Rector, Leroy, Wang, and Cobbley. 

Claims 101 , 102. Nickerson in view of Rector and Leroy does not further teach 
an automatic audio analyzer for analyzing the audio stream to produce text strings that 
are searchable through the user interface. 

Cobbley teaches an apparatus for selectively playing back segments of a video 
by selecting index information associated with the segments (Abstract). The user may 
search for text strings to locate the selectable segment (col. 10, II. 21-38; col. 12, II. 41- 
56). The text strings may be generated by an automatic audio analyzer (col. 4, II. 41- 
43). 

It is obvious to combine known elements according to known methods to yield 
predictable results. Therefore, it would have been obvious to combine Cobbley's 
automatic audio analyzer with the apparatus of Nickerson in view of Rector and Leroy 
according to the described method of searching for and selecting video segments using 
text strings, thus yielding predictable results because the apparatus divides videos into 
selectable segments (time slices). 
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Claim 106 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Nickerson in view of Rector, Lattibeaudiere, and US 6104948 ("Bogart"). 

Nickerson in view of Rector do not teach that multiple video streams are stored in 
the associative mapping. Bogart teaches a similar system for storing response data 
correlated with video data (Abstract). Multiple video streams may be correlated (Fig. 2; 
col. 2, II. 54-56), the video streams including a scene video and a subject video (col. 3, 
II. 30-31). Like in Rector, the stored data may be stored both as a videotape and 
digitally in long term memory for analysis (col. 4, II. 35-41). 

It would have been obvious to correlate responses with multiple video streams as 
taught by Bogart for the purpose of providing a scene view of a subject and a subject 
view, thus storing both broad and detailed stimulus information to allow a better analysis 
of the responses. 

Conclusion 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 . 1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
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the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Bennett Ingvoldstad whose telephone number is (571) 
270-3431 . The examiner can normally be reached on M-F 9-5 EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Scott Beliveau can be reached on (571) 272-7343. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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